Methods and systems for providing alerts to a connected vehicle driver and/or a passenger via condition detection and wireless communications

ABSTRACT

A monitoring system for a vehicle can use one or more sensors to monitor a condition external to a vehicle while a driver is operating the vehicle and the vehicle is temporarily stopped. The system can detect a change in the condition external to the vehicle and transmit a signal wirelessly to a computing device of the driver, which can cause the computing device to output an alert indicating the change in the condition external to the vehicle.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/488,694, filed on Apr. 17, 2017; which is a continuation-in-part ofU.S. patent application Ser. No. 15/396,728, filed on Jan. 2, 2017 (nowU.S. Pat. No. 9,824,582); which is a continuation of U.S. patentapplication Ser. No. 14/661,065 (now U.S. Pat. No. 9,610,893), filed onMar. 18, 2015; the aforementioned applications being hereby incorporatedby reference in their respective entireties.

TECHNICAL FIELD

Embodiments are generally related to the field of connected vehiclesincluding autonomous vehicles. Embodiments also relate to electronicmobile wireless devices that communicate with such connected vehicles.Embodiments also relate to connected vehicle technology and thedeployment of electronic mobile wireless devices in the context ofconnected vehicles. Embodiments are additionally related to thedetection of external and internal conditions with respect to a vehicleand the notification of alerts to users regarding such conditions.Embodiments further relate to driver assist technologies.

BACKGROUND

The availability of on-board electronics and in-vehicle informationsystems has accelerated the development of more intelligent vehicles.One possibility is to automatically monitor conditions surrounding avehicle for safety purposes. Another possibility is to automaticallymonitor a driver's driving performance to prevent potential risks.Although protocols to measure a driver's workload have been developed byboth government agencies and the automobile industry, they have beencriticized as being too costly and difficult to obtain. In addition,existing uniform heuristics for driving risk preventions do not accountfor changes in individual driving environments. Hence, technologies forunderstanding a driver's frustrations to prevent potential driving riskshas been listed by many international automobile companies as one of thekey research areas for realizing intelligent transportation systems.

Additionally, there is a need to monitor not only a driver's activity(e.g., driver inattention) but also to monitor the driver's activitywith respect to certain conditions, which may be external to the vehicleor may occur within the vehicle. For example, a driver may beapproaching a red light or the driver may be stopped at a red light andis looking at his cell phone or other distractions instead of beingattentive to the traffic light. There is also a need to monitor variousconditions external to the vehicle and/or internal to the vehicle and toprovide alerts to vehicle passengers about these conditions or changesin such conditions.

BRIEF SUMMARY

The following summary is provided to facilitate an understanding of someof the innovative features unique to the disclosed embodiments and isnot intended to be a full description. A full appreciation of thevarious aspects of the embodiments disclosed herein can be gained bytaking the entire specification, claims, drawings, and abstract as awhole.

It is, therefore, one aspect of the disclosed embodiments to provide forimproved connected vehicle and driver assist methods and systems.

It is another aspect of the disclosed embodiments to provide for amethod and system for alerting a driver and/or a passenger of a vehicleregarding a change in a condition external to the vehicle or within thevehicle.

It is yet another aspect of the disclosed embodiments to provide for amethod and system for issuing alerts to a vehicle driver and/or avehicle passenger via wireless communications.

It is still another aspect of the disclosed embodiments to provide formethods and systems for alerting a vehicle about conditions external tothe vehicle.

It is another aspect of the disclosed embodiments to provide forautonomous vehicles that facilitate the transmission of alerts to avehicle driver and/or a vehicle passenger.

The aforementioned aspects and other objectives and advantages can nowbe achieved as described herein. Methods and system are disclosed foralerting a vehicle driver via wireless communications. Such an approachcan include steps or operations for monitoring one or more conditionswith respect to a vehicle, detecting a change in the condition (orconditions), automatically transmitting a signal wirelessly to acomputing device, wherein the signal is indicative of the change incondition(s), and alerting the driver of the change in condition(s) inresponse to transmitting the signal to the computing device (e.g., atablet computing device, smartphone, smartwatch, etc.).

In some example embodiments, the step or operation of alerting thedriver to the change in condition(s) can further include a step oroperation of providing an audible alert via a speaker associated withthe computing device, wherein the audible alert indicative of the changecondition(s). In another example embodiment, the step or operation ofalerting the driver of the change in condition(s) can further includesteps or operations for establishing a wireless connection between thecomputing device and a radio system of the vehicle. And providing anaudible alert from or via the computing device indicative of the changein condition via the radio system. In another example embodiment, thestep or operation of alerting the driver of the change condition(s) canfurther include or involve a step or operation for alerting the driverof the change in the condition by a text message displayable through thecomputing device.

In another example embodiment, the step or operation of monitoring thecondition(s) with respect to the vehicle can further involve monitoringof the condition with one or more cameras (e.g., a video camera,high-definition video camera, etc.). In some example embodiments, one ormore of such cameras can be a 360 degree video camera. In otherembodiments, monitoring the condition(s) with respect to the vehicle mayalso involve monitoring condition(s) with one or more sensors, either bythemselves or in association with the aforementioned video camera(s). Inanother example embodiment, the step or operation of monitoring thecondition(s) with respect to the vehicle can involve a step or operationof analyzing video data from the video camera(s) (e.g., an HD videocamera, a 360 degree video camera etc.) utilizing anomaly detection(e.g., an anomaly detection module, anomaly detection mechanism, etc.).In yet another example embodiment, the step or operation of monitoringthe condition(s) can further involve a step or operation for analyzingvideo data captured by the video camera(s) utilizing AI (ArtificialIntelligence) such as, for example, machine learning. In still anotherexample embodiment, the step or operation of monitoring the condition(s)with respect to the vehicle can further involve or include a step oroperation for analyzing video data obtained from the video camera(s)utilizing location data (e.g., GPS data, beacon data) from a locationmodule (e.g., GPS module, beacon module, etc.) associated with thecomputing device. The location data can be employed to cross-referencelocation identification information, for example, with respect to itemsor objects identified from the video data obtained from the videocamera(s).

In another example embodiment, a method can be implemented for alertinga vehicle driver via wireless communications, wherein such a methodincludes steps or operations for monitoring condition(s) external to avehicle while the vehicle is in operation and a driver of the vehicle islocated in a driver seat of the vehicle, detecting a change in thecondition(s); transmitting a signal wirelessly to a computing device,wherein the signal indicative of a change in the condition(s); andalerting the driver regarding the change in condition(s), aftertransmission of the signal to the computing device.

In some example embodiments, the step of alerting the driver of thechange in the condition(s) after transmission of the signal to thecomputing device, can further involve a step or operation of providingor issuing an audible alert via a speaker associated with the computingdevice, wherein the audible alert is indicative of the change incondition(s).

In another example embodiment, the step or operation of alerting thedriver of the change in condition(s) after transmission of the signal tothe computing device, can further include steps or operations forestablishing a wireless connection between the computing device and aradio system of the vehicle; and issuing or providing an audible alertfrom the computing device which is issued (e.g., played or broadcast)through the vehicle's radio system, wherein the audible alert isindicative of the change in condition. In such a situation the radiosystem is in communication with the computing device. The computingdevice may be a separate wireless mobile electronic device such as asmartphone, smartwatch or tablet computing device associated with thedriver and/or a passenger (or passengers) in the vehicle, or thecomputing device may be a computing system integrated with the vehicleand which communicates electronically with the radio system. In someexample embodiments, the “vehicle in operation” may involve the vehiclein motion or the vehicle temporarily stopped (e.g., at an intersection,dropping or picking up a passenger, etc.). In another exampleembodiment, the step or operation of alerting the driver of the changein condition(s), after transmission of the signal to the computingdevice, can further involve a step or operation of providing an audiblealert via a speaker associated with the computing device, the audiblealert indicative of the change in condition(s).

In yet another example embodiment, the step or operation of alerting thedriver of the change in the condition(s) after transmission of thesignal to the computing device, can further involve steps or logicaloperations for establishing a wireless connection between the computingdevice and a radio system of the vehicle; and providing an audible alertfrom the computing device indicative of the change in the condition(s)via the radio system. In still another example embodiment, the step oroperation of monitoring a condition external to the vehicle while thevehicle is in operation and the driver of the vehicle is located in thedriver seat of the vehicle, can further include a step or operation omonitoring the condition(s) with a camera (e.g., video camera, HDcamera, 360 degree video camera, etc.) that communicates with thecomputing device. In some example embodiments, the video camera may beintegrated with the computing device (e.g., a tablet computing devicevideo camera, smartphone video camera, etc.), while in otherembodiments, the camera may be a standalone camera positioned within thevehicle to monitor the condition(s) and which communicates via awireless connection with the computing device (e.g., tablet computingdevice, smartphone, smartwatch, integrated in-vehicle computing system,etc.).

In still another example embodiment, a step or operation can be providedfor tracking and recording in a memory of a computing system (e.g., aserver, an in-vehicle computing system, a tablet computing device, asmartphone, a smartwatch, laptop computer, desktop computer, etc.), dataindicative of the number of times the driver is alerted to changes inconditions. In another example embodiment, steps or operations can beimplemented for periodically retrieving such tracked and recorded datafrom the memory, and transmitting the data wirelessly from the computingsystem to a central repository (e.g., a server) for further storage andanalysis. Note that in some example embodiments, the condition(s)external to the vehicle may be a stop light condition (e.g., trafficlight) and the change in the condition(s) involves a change from onestop light color to another stop light color (e.g. red to green, greento red, green to yellow, etc.).

In another example embodiment the step or operation of transmitting thesignal wirelessly to the computing device, wherein the signal isindicative of the change in condition(s), can further involve a step oroperation for transmitting the signal wirelessly through a PAN (PersonalArea Network). In some example embodiments, the PAN may be a networkenabled for Bluetooth wireless communications, induction wirelesscommunications, infrared wireless communications, ultra-widebandwireless communications and/or ZigBee wireless communications. In someexample embodiments, the wireless connection between the computingdevice and the radio system can be established via Secure Simple Pairing(SSP).

In another example embodiment, the step or operation of detecting thechange in the condition(s) can involve utilizing anomaly detection ormachine learning approaches for detecting the change in thecondition(s).

In yet another example embodiment, steps or operations can be providedfor determining if the vehicle is no longer in operation, monitoring thecondition(s) within the vehicle, in response to determining that thevehicle is no longer in operation, determining if the condition(s)within the vehicle comprises an anomalous condition; and wirelesslytransmitting an alert to a computing device associated with the user,the alert indicative of the anomalous condition, if is determined thatthe condition(s) comprises the anomalous condition (i.e., if it isdetermined that the condition or conditions are anomalous). Note that insome example embodiments, the alert can be wirelessly transmitted as atext message to the computing device via a wireless network, wherein thetext message is displayed via a display screen associated with thecomputing device.

In another example embodiment, a system for alerting a vehicle drivervia wireless communications, can be implemented. Such a system caninclude, for example, a video camera (i.e., one or more video cameras),one or more processors which communicate with and process video datacaptured by the video camera, and a computer-usable medium embodyingcomputer program code, wherein the computer-usable medium capable ofcommunicating with the processor(s). The computer program code caninclude instructions executable by the processor(s) and configured, forexample, for: monitoring condition(s) with respect to the vehicle withthe video camera, detecting a change in the condition(s) monitored viathe video camera, transmitting a signal wirelessly to a computingdevice, the signal indicative of the change in condition(s), andalerting the driver of the change in condition(s) in response totransmitting the signal to the computing device. As indicatedpreviously, the computing device may be, for example, mobile electronicdevice such as a smartphone, tablet computing device, laptop computerand so on. In some example embodiments, the computing device may be anin-vehicle computing system that communicates wirelessly with othercomputing devices such as the driver's and/or a passenger's smartphone,tablet computing device, etc.

In some example embodiments, the instructions for alerting the driver ofthe change condition(S) can be further configured for providing anaudible alert via a speaker associated with the computing device,wherein the audible alert is indicative of the change condition(s). Inyet another example embodiment, the instructions for alerting the driverof the change in the condition(s) can be further configured forestablishing a wireless connection between the computing device and aradio system of the vehicle; and providing an audible alert from thecomputing device indicative of the change in the condition(s) via theradio system. In another example embodiment, the instructions foralerting the driver of the change in the condition(s) can be furtherconfigured for alerting the driver of the change in the condition(s) bya text message displayable through the computing device and/or played orbroadcast as a voice alert through the computing device. As indicatedpreviously, the camera(s) may be, for example, a video camera, HD videocamera, 360 degree video camera, and so on. In some example embodiments,one or more sensors (e.g., temperature sensor, pressure sensor, velocitysensor, acceleration sensor, vehicle heading sensor, etc.) may beemployed for use in monitoring the conditions external to or within thevehicle.

In some example embodiments, the instructions for monitoring thecondition(s) can be further configured for analyzing the video datacaptured from the video camera utilizing anomaly detection or machinelearning techniques. In still other embodiments, the instructions formonitoring the condition(s) can be configured for analyzing the videodata captured from the 360 degree video camera utilizing, for example,location data from a location or locating module (e.g., beacon module,GPS module, etc.) associated with the computing device and inassociation with the captured video data.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying figures, in which like reference numerals refer toidentical or functionally-similar elements throughout the separate viewsand which are incorporated in and form a part of the specification,further illustrate the present invention and, together with the detaileddescription of the invention, serve to explain the principles of thepresent invention.

FIG. 1 illustrates a schematic diagram of driver alerting system, inaccordance with a preferred embodiment;

FIG. 2(a) illustrates an example computing device constituting asmartphone or tablet computing device, which may be adapted for use inaccordance with one embodiment;

FIG. 2(b) illustrates an example camera, which may be located in avehicle for monitoring conditions external to the vehicle, in accordancewith another embodiment;

FIG. 3 illustrates a method for alerting a vehicle driver via wirelesscommunications, in accordance with an embodiment;

FIG. 4 illustrates a method for alerting a vehicle driver, in accordancewith an alternative embodiment;

FIG. 5 illustrates a method 50 for tracking driver activity, inaccordance with an alternative embodiment;

FIG. 6 illustrates a method 60 for monitoring conditions with respect toa vehicle, in accordance with an alternative embodiment;

FIG. 7 illustrates a schematic diagram of a system for alerting avehicle driver via wireless communications, in accordance with analternative embodiment;

FIG. 8 illustrates a schematic diagram of a system for alerting avehicle driver via wireless communications, in accordance with analternative embodiment;

FIG. 9 illustrates a schematic diagram of a system for alerting avehicle driver via wireless communications, in accordance with analternative embodiment;

FIG. 10 illustrates a method for alerting a vehicle driver of a changein traffic light conditions via wireless communications, in accordancewith an embodiment;

FIG. 11 illustrates a schematic view of a computer system, in accordancewith an embodiment;

FIG. 12 illustrates a schematic view of a software system including amodule(s), an operating system, and a user interface, in accordance withan embodiment; and

FIG. 13 illustrates a schematic diagram of driver alerting system, inaccordance with an alternative embodiment.

DETAILED DESCRIPTION

The particular values and configurations discussed in these non-limitingexamples can be varied and are cited merely to illustrate one or moreembodiments and are not intended to limit the scope thereof.

Subject matter will now be described more fully hereinafter withreference to the accompanying drawings, which form a part hereof, andwhich show, by way of illustration, specific example embodiments.Subject matter may, however, be embodied in a variety of different formsand, therefore, covered or claimed subject matter is intended to beconstrued as not being limited to any example embodiments set forthherein; example embodiments are provided merely to be illustrative.Likewise, a reasonably broad scope for claimed or covered subject matteris intended. Among other things, for example, subject matter may beembodied as methods, devices, components, or systems. Accordingly,embodiments may, for example, take the form of hardware, software,firmware or any combination thereof (other than software per se). Thefollowing detailed description is, therefore, not intended to be takenin a limiting sense.

Throughout the specification and claims, terms may have nuanced meaningssuggested or implied in context beyond an explicitly stated meaning.Likewise, the phrase “in one embodiment” as used herein does notnecessarily refer to the same embodiment and the phrase “in anotherembodiment” or “in another example embodiment” (and variations thereof)as used herein does not necessarily refer to a different embodiment. Itis intended, for example, that claimed subject matter includecombinations of example embodiments in whole or in part.

In general, terminology may be understood, at least in part, from usagein context. For example, terms, such as “and”, “or”, or “and/or” as usedherein may include a variety of meanings that may depend, at least inpart, upon the context in which such terms are used. Typically, “or” ifused to associate a list, such as A, B, or C, is intended to mean A, B,and C, here used in the inclusive sense, as well as A, B, or C, hereused in the exclusive sense. In addition, the term “one or more” as usedherein, depending at least in part upon context, may be used to describeany feature, structure, or characteristic in a singular sense or may beused to describe combinations of features, structures, orcharacteristics in a plural sense. Similarly, terms such as “a”, “an”,or “the”, again, may be understood to convey a singular usage or toconvey a plural usage, depending at least in part upon context. Inaddition, the term “based on” may be understood as not necessarilyintended to convey an exclusive set of factors and may, instead, allowfor existence of additional factors not necessarily expressly described,again, depending at least in part on context.

FIG. 1 illustrates a schematic diagram of a system 10 for alerting avehicle driver via wireless communications, in accordance with apreferred embodiment. System 10 monitors one or more conditions withrespect to a vehicle, preferably (but not necessarily) while the vehicleis in operation and the driver of the vehicle is located in thevehicle's driver's seat. The conditions may be external to the vehicleor internal depending upon the application or need. In the example shownin FIG. 1, the change in condition is depicted a change in the color ofa traffic light 22. A camera 19 (e.g., a video camera) is shown in FIG.1 as located on a dashboard with respect to a front vehicle windshield18. For example, the traffic light 22 may change from red to green andan alert 24 is issued alerting the driver of the change in color when achange in the condition (i.e., change in color, in this case) isdetected. The monitoring activity (e.g., monitoring the traffic light22) is indicated in FIG. 1 by dashed arrow 17. As will be discussed ingreater detail herein, such monitoring activity can be facilitated bythe camera 19 and other components and modules.

The alert 24 may be transmitted wirelessly to, for example, the user'smobile electronic wireless computing device 21 (e.g., a smartphone,tablet computing device, smartwatch, wearable device, etc.) or to adevice or system (e.g., an in-vehicle computing system) integrated withthe vehicle. Note that electronic devices such as smartphones,smartwatches, personal digital assistants (PDAs) mobile telephones,tablet devices, laptops and other Internet connectivity devices (“mobilestations”) provide users with mobile access to various informationresources. Such mobile stations generally operate via a cellular 3G or4G broadband data communication standard and/or a WIFI networkconnection to a local area network. In FIG. 1 the computing device isshown as a MD (Mobile Device) 21. It can be appreciated, however, thatin some example embodiments, the computing device can be a computingdevice such as an integrated in-vehicle computing device, a mobiledevice or a combination an integrated in-vehicle computing device and amobile device such as MD 21 in bidirectional packet based wirelesscommunication (or direct communication via, for example, a USB wiredconnection) with one another (e.g., Bluetooth wireless communications,802.11 wireless communications, cellular communications, etc.).

In the example embodiment depicted in FIG. 1, the monitoring activity(e.g., monitoring the traffic light or other conditions such aspedestrian movement) can be facilitated by one or more cameras such as,for example, a camera 19 which may be located on the dashboard of thevehicle with a view through the vehicle windshield 18. In such asituation, the camera 19 may be, for example, a dashcam. A dashboard isa preferable location for a camera such as camera 19, but it should beappreciated that the camera 19 may be located in other positions withinthe vehicle, such as in the front of the vehicle near or by back orfront bumper. In the example depicted in FIG. 1, only a single camera 19is shown. In other example embodiments, as will be explained in greaterdetail herein, more than one camera may be implemented in the context ofa vehicle. In other words, in some example embodiments, multiple camerasmay be deployed on the vehicle (within the vehicle passenger compartmentand/or external to the passenger compartment on the vehicle body). Inthe FIG. 1 scenario, camera 19 is shown monitoring the externalcondition (e.g., traffic light 22 changing color) through the windshield18.

FIG. 2(a) illustrates an example computing device 21, which is shown asa smartphone implementation. It can be appreciated, however, that thecomputing device 21 can be implemented as other types of wireless mobiledevices, such as a tablet computing device, and wearable devices such asa smartwatch.

A non-limiting example of a wearable device such as a smartwatch, whichcan be utilized as computing device 21 is depicted in U.S. Pat. No.8,854,925 entitled “Smart Watch and Control Method for the Same,” whichissued on Oct. 7, 2014 and is incorporated herein by reference. Anothernon-limiting example of a smartwatch that can be adapted for use ascomputing device 21 is disclosed in U.S. Pat. No. 8,279,716 entitled“Smart-Watch Including Flip-Up Display,” which issued on Oct. 2, 2012and is incorporated herein by reference. Note that the terms “smartwatch” and “smartwatch” and “smart-watch) can be utilizedinterchangeably to refer to the same type of device.

Another example of a wearable device that can be implemented ascomputing device 21 is an OHMD (Optical Head-Mounted Display) that canbe equipped with a video camera. OHMD is a wearable display that has thecapability of reflecting projected images as well as allowing the userto see through it that is augmented reality.

The computing device 21 can incorporate a video camera 19. In someexample embodiments, the example computing device 21 with camera 19 maybe implemented in the context of, for example, a smartphone or tabletcomputing device located or mounted on the vehicle dashboard orelsewhere within the vehicle (or located on the vehicle external to thepassenger compartment). The alert 24 may be broadcast as an audio alertor text alert message through the computing device 21. In some exampleembodiments, the alert can be transmitted in the context of a voicealert, which is discussed further herein.

In another example embodiment, the camera 19 may be implemented as astandalone camera that communicates wirelessly with the computing device21 via wireless communications as described in greater detail herein.FIG. 2(b) illustrates an example camera 19, which may be located in anoptimal location with the vehicle for monitoring conditions external tothe vehicle, in accordance with another embodiment. In the FIG. 2(b)implementation, the camera 19 may communicate wirelessly with thecomputing device 21. One non-limiting example of a video camera whichmay adapted for use as, for example, camera 19 shown in FIG. 2(b) isdisclosed in U.S. Patent Application Publication No. 20140047143entitled “Wireless video camera and connection methods including a USBemulation,” which issued on Feb. 13, 2014 and is incorporated herein byreference in its entirety.

Camera 19 may also be implemented as, for example, a so-called dashcamor dash cam. A dashcam (dashboard camera) is an onboard camera thatattaches to the vehicle's interior windscreen by either a suppliedsuction cup mount or an adhesive-tape mount. It can also be positionedon top of the dashboard or attached to the rear-view mirror with aspecial mount. It continuously records the road ahead while the vehicleis in motion. Various types of dashcam can be implemented as camera 19,ranging from basic video cameras to those capable of recordingparameters such as date/time, speed, G-forces and location. In someexample embodiments, camera 19 may be implemented as a wearable videocamera that monitors conditions external to the vehicle or within thevehicle. Such a video camera may be, for example, a lapel camera worn bya the vehicle driver and/or a passenger.

FIG. 3 illustrates a method 20 for alerting a vehicle driver viawireless communications, in accordance with an embodiment. As indicatedat block 24, the process begins. Thereafter, as shown at block 26, astep or logical operation can be implemented for monitoring one or moreconditions external to the vehicle and optionally while the vehicle isin operation and the driver of the vehicle is located in a driver seatof the vehicle.

Note that such a monitoring step or logical operation may involvemonitoring the condition with a camera that communicates with thecomputing device. The camera may be integrated the computing device(e.g., a Smartphone or tablet computer). In other embodiments, such acamera may be a standalone camera positioned within the vehicle tomonitor the condition and the camera may also communicate via a wirelessconnection (e.g., Bluetooth or other wireless communication as discussedin greater detail herein) with the computing device.

Monitoring can involve the use of object recognition or other videoimage recognition techniques and systems. For example, in one embodimenta traffic recognition approach can be utilized as part of the videomonitoring operation. One example of a traffic object recognitionapproach that can be adapted for use in accordance with an embodiment isdisclosed in U.S. Patent Application Publication No. 2011/0184895entitled “Traffic Object Recognition System, Method for Recognizing aTraffic Object, and Method for Setting up a Traffic Object RecognitionSystem,” which published to Janssen on Jul. 28, 2011 and is incorporatedherein by reference in its entirety. Another object recognition approachthat can be adapted for use in accordance with an alternative embodimentis disclosed in U.S. Pat. No. 8,447,139 entitled “Object recognitionusing Haar features and histograms of oriented gradients,” which issuedon May 21, 2013 and is incorporate herein by reference in its entirety.

Next, as illustrated at decision block 28, a test can be performed todetermine if a change has been detected the monitored conditions (orconditions). If a change is detected, then as disclosed at block 30, astep or logical operation can be implemented for transmitting a signalwirelessly to a computing device, wherein such a signal indicative ofthe change in the condition(s) monitored. Thereafter, as shown at block32, a step or logical operation can be implemented to alert the driverof the change in the condition after transmission of the signal to thecomputing device.

It can be appreciated that the vehicle in operation may be, for example,temporarily stopped (e.g., at an intersection/stop light, a parking lot,in traffic, etc.) or in motion. In some implementations, the computingdevice that receives and plays the alert (e.g., an audio signal or voiceannouncement) may be, for example, a smartphone or a tablet computingdevice. In other embodiments, the computing device may be integratedwith the vehicle as part of an in-vehicle system that provides alertsand other information (e.g., GPS information) to the vehicle'soccupants. Such a system typically includes a dashboard display. Oneexample of a non-limiting in-vehicle system that can be adapted for usein accordance with an alternative embodiment is disclosed in US PatentApplication Publication No. 20110034128 entitled “Mobile CommunicationDevice Linked to In-Vehicle System,” which published on Feb. 10, 2011and is incorporated herein by reference in its entirety. Yet anotherexample of a non-limiting in-vehicle system that can be adapted for usein accordance with an alternative embodiment is disclosed in U.S. Pat.No. 8,417,211 entitled “In-Vehicle System (IVS) Control of EmergencyData Communications,” which issued on Apr. 9, 2013 and is incorporatedherein by reference in its entirety.

It can also be appreciated that the in the context of a tablet orsmartphone implementation, the computing device may not necessarilybelong to the vehicle driver but may, for example, be a computing device(e.g., hand held wireless electronic device, smartphone, tablet, etc.)belonging to passengers.

FIG. 4 illustrates a method 40 for alerting a vehicle driver, inaccordance with an alternative embodiment. In some example embodiments,the step or logical operation of alerting the driver of the change incondition after transmission of the signal to computing device, canfurther involve providing an audible alert via a speaker associated withthe computing device, wherein the audible alert indicative of the changein the monitored condition. Such an alerting operation may involveestablishing a wireless connection between the computing device and aradio system of the vehicle as shown at block 42, and providing theaudible alert from the computing device via the radio system, asindicated at block 44.

FIG. 5 illustrates a method 50 for tracking driver activity, inaccordance with an alternative embodiment. It can be appreciated that insome example embodiments, the disclosed monitoring method/system can bemodified to monitor not just external conditions or activities, but theactivity of the driver itself in order to track, for example, driverinattentiveness. As depicted at block 52, a step or logical operationcan be implemented for tracking and recording in a memory of a computingsystem data indicative of the number of times the driver is alerted to achange a condition. Then, as shown at block 54, a step or logicaloperation can be implemented to periodically retrieve such data from thememory, and as shown at block 56, transmit such data wirelessly from thecomputing system to a central repository for further storage andanalysis. Such data (e.g., telematics, telematics data, etc.) may beuseful, for example, for insurance companies, including insurancecompanies involved in the UBI (Usage-Based Insurance) industry.

FIG. 6 illustrates a method 60 for monitoring conditions with respect toa vehicle, in accordance with an alternative embodiment. As indicated atblock 62, the process is initiated. Thereafter, as depicted at decisionblock 64, a test can be performed to determine if the vehicle is inoperation. If it is determined that the vehicle is in operation, thenthe process ends, as shown at block 72. If it is determined that thevehicle is no longer in operation (e.g., the key is removed from theignition), then as indicated at block 66, conditions within the vehicleare monitored. For example, a camera and/or sensors may monitorconditions within the vehicle (or external to the vehicle).

As depicted at block 68, a test is performed to determine if conditionsanomalous. Anomalous conditions may include one of a variety of possibleconditions. For example, an anomalous condition may be a change intemperature in the vehicle. Another anomalous condition may be, forexample, the presence of someone in the vehicle who normally would notstill be in the vehicle after the car is turned off or, for example, thevehicle doors are closed and/or locked. If such an anomalous conditionis detected, then as indicated at block 70, an alert may be wirelesslytransmitted to a computing device associated with a user (e.g., thevehicle driver, a passenger, etc.) indicating such an anomalouscondition. It can be appreciated in some example embodiments, the alertor alerts can be provided to the vehicle driver, a vehicle passengerand/or both. In autonomous or self-driving vehicles, such alerts may betransmitted to a passenger in the self-driving vehicle. The process canthen terminate, as depicted at block 72. Note that in some exampleembodiments, such an alert may be wirelessly transmitted as a textmessage to the computing device via a wireless network. Such a wirelessnetwork can be, for example, a cellular telephone network and/or a WiFinetwork.

A text message alert can be implemented via for example, Short MessageService (SMS), SkyMail, Short Mail, Instant Messaging (IM), chat, MobileInstant Messaging (MiM), Multimedia Messaging Service (MMS), and othermessaging services. Text messaging is supported by computer devices suchas laptop computers, desktop computers, handheld computers, and wirelessdevices such as cellular telephones, Wireless Local Area Network (WLAN)terminals, Wireless Wide Area Network (WWAN) terminals, and WirelessPersonal Area Network (WPAN) terminals, for example.

Typically, a text message server serves as an intermediate device forreceiving a text message from a source device, storing the text message,and forwarding the text message to a recipient device, e.g., a firstcell phone as a source device and a second cell phone as a recipientdevice. While some text message service providers charge for textmessage support, e.g., cellular networks, other text message serviceproviders support text messaging without charge. Various protocols suchas SS7, GSM MAP, or TCP/IP, for example, may be employed to support textmessaging.

In some example embodiments, the alert regarding a change in conditioncan be implemented in the context of a notification service. In oneexample, the text message may be sent as a push notification across acellular or wireless communication network to the computing device.Certain text messaging protocols may be used, such as, mobile shortmessage service (SMS), multimedia message service (MMS), and instantmessaging (IM), or any other related text application. The communicationmedium may include transferring information over communication links,such as wireless networks (e.g., GSM, CDMA, 3G, 4G, etc.), wirelinenetworks (e.g., landline telephony), Internet, satellite/cable networks,or, any other data medium using standard communication protocols.

An example of a notification service that can be adapted for use with analternative embodiment is disclosed in U.S. Pat. No. 8,751,602 entitled“Method and Apparatus of Providing Notification Services to SmartphoneDevices,” which issued on Jun. 10, 2014 and is incorporated herein byreference in its entirety. Another non-limiting example of a system thatcan be adapted for use in accordance with an alternative embodiment fordelivery of an alert regarding a change in condition is disclosed inU.S. Pat. No. 8,265,938 entitled “Voice Alert Methods, Systems andProcessor-Readable Media,” which issued on Sep. 11, 2012 and isincorporated herein by reference in its entirety.

An example of a situation where the method 60 would be useful is thecase of a child accidentally being left in a vehicle during hot weather.A camera in the vehicle operating via battery power or residualelectricity from the vehicle electrical system may detect an anomalysuch as the child in a rear car seat. The anomaly in this case would bethe presence (e.g., detection of the child moving, turning his or herhead, moving his or her arms, legs, etc.) of a child in a car seat,wherein a child would not normally be in the car seat after the car isno longer in operation and/or after the doors are closed/locked, and/orafter a particular amount of time (e.g., 5 minutes, 10 minutes, etc.).Note that a cellular network or cellular link or service such as OnStarcan be utilized for sending out an alert (e.g., text message, audioalert) etc. to let them know that a child may have been left in a carseat.

Audio sensors may also be employed to detect, for example, the sound ofa crying child. A temperature sensor could also be utilized to detect arise in temperature to an unsafe level for humans and when thattemperature threshold is met, the alert is transmitted wirelessly to theuser's hand held device (e.g., smartphone, tablet, smartwatch or otherwearable device, etc.). Such an approach could thus be utilized toprevent tragic and unnecessary deaths in automobiles due to heatstroke.

Note that the step or logical operation of anomaly detection or outlierdetection shown in block 68 can involve the identification of items,events or observations which may not conform to an expected pattern orother items in a dataset. Anomalies are also referred to as outliers,novelties, noise, deviations and exceptions. In the context of abuse andnetwork intrusion detection, “interesting” objects are often not rareobjects, but unexpected bursts in activity. This pattern does not adhereto the common statistical definition of an outlier as a rare object, andmany outlier detection methods (in particular unsupervised methods) willfail on such data, unless it has been aggregated appropriately. Instead,a cluster analysis algorithm may be able to detect the micro clustersformed by these patterns.

The anomaly detection operation shown at block 68 can preferably beimplemented by an anomaly detection mechanism based on a number ofpossible categories of anomaly detection including but not limited to,unsupervised anomaly detection, supervised anomaly detection,semi-supervised anomaly detection, etc. An unsupervised anomalydetection technique can be employed detect anomalies in an unlabeledtest data set under the assumption that the majority of the instances inthe data set are normal by looking for instances that seem to fit leastto the remainder of the data set. Alternatively, a supervised anomalydetection technique may be employed, which requires a data set that hasbeen labeled as “normal” and “abnormal” and involves training aclassifier (the key difference to many other statistical classificationproblems is the inherent unbalanced nature of outlier detection).Semi-supervised anomaly detection techniques may also be employed, whichconstruct a model representing normal behavior from a given normaltraining data set, and then testing the likelihood of a test instance tobe generated by the learnt model.

FIG. 7 illustrates a schematic diagram of a system 70 for alerting avehicle driver via wireless communications, in accordance with analternative embodiment. System 70 includes a module (or group ofmodules) 72 including a monitoring module 74, an alerting module 76, atracking module 78, and a recording module 80. Module 72 can communicatewirelessly with a computing device 84 (e.g., a driver/passengersmartphone, tablet computer, etc.), which in turn can communicatewirelessly with the vehicle radio system 86. One or more sensor(s) 83can communicate with module 72 and one or more camera(s) 82 maycommunicate with the module 72. The sensor(s) 83 and the camera(s) 82can communicate with module 72 via wireless or wired communications.Note that the camera (or cameras) 82 are similar or analogous to thecamera 19 discusses previously herein. The computing device 84 is alsoin some example embodiments similar or analogous to the electronicwireless device 21 discusses previously herein.

Examples of sensors that can be utilized to implement sensor(s) 83 aresensors such as temperature sensors, pressure sensors, velocity sensors,acceleration sensors, vehicle heading sensors, yaw-rate sensors, and soon. One example of a vehicle heading sensor approach that can be adaptedfor use as or with sensor(s) 83 in accordance with an alternativeembodiment, is disclosed in U.S. Pat. No. 7,957,897 entitled “GPS-basedin-vehicle sensor calibration algorithm,” which issued on Jun. 7, 2011and is incorporated herein by reference in its entirety. The GPS modulediscussed herein can be utilized in association with such sensors toprovide location or position data with respect to the vehicle and alsoprovide vehicle heading sensor data.

Note that in some example embodiments, the computing device 84 cancommunicate with the vehicle radio system via wireless communicationsestablished via Secure Simple Pairing (SSP). The sensor(s) 83 and thecamera(s) 82 and the computing device 84 may also in some exampleembodiments communicate with module 72 via SSP. SSP, which requires lessuser interaction utilizes a one-time six-digit key displays at the timeof pairing on both the device and the car, replacing the PIN code. Oncethe user confirms that the keys match, the two devices can be paired.

The monitoring module 74 can implement the monitoring steps oroperations discussed previously. For example, monitoring module 74 canmonitor traffic lights or other conditions (i.e., conditions external tothe vehicle or within the vehicle) facilitated by, for example,camera(s) 82 and/or sensor(s) 83. The monitoring module 74 can be, forexample, an anomaly detection mechanism that detects changes inconditions as discussed previously.

The alerting module 76 serves to alert the driver of the detected changein a condition. The alert (e.g., an audio alert, a text message, etc.)can be broadcast through, for example, the computing device 84 or thevehicle radio system 86 (assuming the vehicle radio system 86 is pairedwith the computing device 84). The tracking module 78 and the recordingmodule 80 function to respectively track and record in a memory of acomputing system (e.g., the computing device 84, an onboard computingsystem, etc.) data indicative of, for example, the number of times thedriver is alerted to changes in conditions. Such data can be retrievedfrom the computer memory and then transmitted to, for example, a centralrepository for further storage and analysis.

It can be appreciated that in some cases, the connections between thevarious components shown in FIG. 7 may be implemented via wirelesscommunications and/or wired connections. For example, the module 72 canbe stored and retrieved from a computer memory which may be, forexample, a memory of computing device 84, a memory of an integratedin-vehicle computing system, and/or a remote computing device or systemsuch as a remote server. Wireless communications can occur through awireless network such as an in-car PAN (Personal Area Network) includingBluetooth communications, or other communications means such as, forexample, a cellular network.

FIG. 8 illustrates a schematic diagram of a system 70 for alerting avehicle driver via wireless communications, in accordance with analternative embodiment. System 70 shown in FIG. 8 is an alternativeversion of system 70 depicted in FIG. 7. The embodiment shown in FIG. 8includes similar or identical components to the FIG. 7 embodiment withsome slight variations. For example, FIG. depicts a wireless networkthrough which the various components can communicate. In one embodiment,for example, the wireless network 85 may implement an in vehicleBluetooth wireless communications system. The signal containing dataindicative of the alert can be wirelessly transmitted to the computingdevice 84 (assuming the computing device 84 in this case is, forexample, a Bluetooth enabled smartphone or tablet computing device). Insome example embodiments, the computing device 84 (assuming a Bluetoothenabled device) may be associated with one or more Bluetooth automotivespeakers wherein the signal is processed via the computing device 84 asan audio signal that can be played through the Bluetooth automotivespeaker.

The wireless network 85 may be implemented as a PAN (Bluetooth orotherwise), and the signal transmitted through the PAN. It should beappreciated that wireless network 85 may be implemented not just viaBluetooth communications, but through one of a number of possiblealternative PAN wireless technologies. For example, in one embodimentwireless network 85 may be implemented as a PAN based on inductionwireless technology, which uses magnetic induction rather than radio forclose-range communications. In radio, both electric and magnetic fieldsmake up the signal, while in induction wireless, only the magnetic fieldis transmitted. The transmitter in this context is a radiating coil thatis more like the primary winding of a transformer than an antenna. A PANbased on an induction wireless approach has about a 3-m range. A typicalunit transmits up to 204.8-kbit/s data rates via GMSK modulation on 11.5MHz. Key benefits of induction wireless technologies are extremely lowpower consumption, low cost, and the inherent security that accompaniesshort range.

Another implementation of wireless network 85 can involve the use ofinfrared wireless communications. Such a PAN technology can be employedfor use over short distances. The IrDA infrared (IR) standard appearedduring the early 1990s, and can be utilized to implement wirelessnetwork 85 as a PAN network. IrDA initially offered a 115.2-kbit/s datarate over a range of up to 1 m. A 4-Mbit/s version was soon developedand has been widely incorporated in laptops and PDAs for printerconnections and short-range PANs. A 16-Mbit/s version is available too

The problem with IrDA is not just its very short range, but also itsneed for a line-of-sight (LOS) connection. Of course, Bluetooth does notneed LOS, and it can blast through walls. A more recent IR developmentis IrGate, which was produced by Infra-Com Technologies. This new IRdevelopment uses arrays of high-powered IR LEDs to emit coded basebandIR in all directions. Then, it relies on an array of photodetectors andsuper-sensitive receivers to pick up the diffused IR within thenetworking space. Thus, the LOS problem is mitigated, and a data rate ofup to 10 Mbits/s is possible.

Still another wireless technology for implementing wireless network 85in the context of, for example, an in-vehicle PAN is UWB (UltraWideband), which transmits data by way of baseband pulses applieddirectly to the antenna. The narrow pulses (less than 1 ns) create anextremely broad bandwidth signal. The pulses are modulated by pulseposition modulation (PPM) or binary phase-shift keying (BPS K). The FCCpermits UWB in the 3.1- to 10.6-GHz band. Its primary application todate has been short-range, high-resolution radar and imaging systemsthat penetrate walls, the ground, and the body. In addition, this newtechnology is useful for short-range LANs or PANs that require very highdata rates (over 100 Mbits/s).

Still another wireless technology for implementing wireless network 85in the context of, for example, an in-vehicle PAN is ZigBee, which is asimpler, slower lower-power, lower-cost cousin of Bluetooth, ZigBee.ZigBee is supported by a mix of companies that are targeting theconsumer and industrial markets. It may be a better fit with games,consumer electronic equipment, and home-automation applications thanBluetooth. Short-range industrial telemetry and remote control are othertarget applications. It can be appreciated, however, that wirelessnetwork 85 can be implemented as a ZigBeen PAN.

Previously referred to as RF-Lite, ZigBee is similar to Bluetoothbecause it uses the 2.4-GHz band with frequency-hopping spread-spectrumwith 25 hops spaced every 4 MHz. The basic data rate is 250 kbits/s, buta slower 28-kbit rate is useful for extended range and greaterreliability. With a 20-dBm power level, ZigBee can achieve a range of upto 134 meters at 28 kbits/s. It additionally allows for networking of upto 254 nodes.

Note that in some example embodiments, whether that of FIG. 7 or FIG. 8or other implementations, camera(s) 82 may be implemented as a 360degree camera which can be employed for use in monitoring not onlyconditions within the vehicle but external to vehicle. In a preferredembodiment, camera (s) 82 and/or camera 19 discussed earlier can beimplemented as an HD (High Definition) 360 degree camera that providesquality video data that can be monitored via, for example, anomalydetection, machine learning and other techniques.

An example of a 360 degree camera that can be adapted for use with oneor more embodiments is the Giroptic 360cam by Gripoptic. Such a deviceincludes three 185-degree fish-eye cameras, allowing it to capture 360degrees of HD video and photos (including time-lapse and HDR). TheGiroptic 360cam captures audio as well as video, and can record 3D soundfrom three microphones. Media can be saved onto a microSD card, which isthen loaded onto a computer via a micro USB port on the unit's base, orvia Wi-Fi. It can be appreciated that such a device (or other 360 degreevideo cameras) can be modified to communicate via other types ofwireless communications, such as Bluetooth communications, cellular, andso forth as discussed herein. Note that reference herein to the Giropticvideo camera is for illustrative purposes only and is not considered alimiting feature of the disclosed embodiments.

FIG. 9 illustrates a schematic diagram of a system 70 for alerting avehicle driver via wireless communications, in accordance with analternative embodiment. In the alternative embodiment of system 70 shownin FIG. 7, the monitoring module 72 can utilize an AD (AnomalyDetection) mechanism or module as discussed previously and/or ML(Machine Learning) and/or GPS (Global Positioning Satellite) modules.

ML techniques can be employed in the context of, for example, analgorithm that operates by building a model from example inputs and usedto make predictions or decisions, rather than following strictly staticprogram instructions. ML can be used to construct a model or rule set topredict a result based on values with respect to a number of features. Aseries of input patterns can be provided to an algorithm along with adesired output (e.g., the label) and the algorithm then learns how toclassify the patterns by outing a desired label. In supervised learning(e.g., Kernal-based support vector machine (SVM) algorithm), a humanoperator must provide the labels during a teaching phase. Alternatively,unsupervised clustering is a process of assigning labels to the inputpatterns without the use of the human operator. Such unsupervisedmethods generally function through a statistical analysis of the inputdata by determining an Eigen value vector of a covariance matrix.

One non-limiting ML technique that can be adapted for use in accordancewith an embodiment is AHaH (Anti-Hebbian and Hebbian) learning, whichcan be employed for feature extraction. One example of an AHaH MLapproach is disclosed in U.S. Pat. No. 8,918,353 entitled “Methods andSystems for Feature Extraction,” which issued on Dec. 23, 2014 and isincorporated herein by reference in its entirety. Another non-limitingML technique that can be adapted in accordance with another embodimentis disclosed in U.S. Pat. No. 8,429,103 entitled “Native MachineLearning Service for User Adaptation on a Mobile Platform,” which issuedon Apr. 23, 2013 and is incorporated herein by reference in itsentirety. It can be appreciated that such ML approaches are referred tofor illustrative purposes only and are not considered limiting featuresof the disclosed embodiments.

In the context of the embodiment shown in FIG. 9, ML can be combinedwith the AD mechanism to recognize patterns in, for example, video datacaptured by video camera (s) 19, 82, etc. to detect changes inconditions external to the vehicle or within the vehicle. Location datamay also be employed to determine the location of the vehicle withrespect to conditions being monitored external or within the vehicle.Location data may include, for example, GPS data and/or other locationdata, such as, beacon data (e.g., “iBeacon” data, etc.). Note that FIG.9 illustrates the use of a GPS module and GPS data (i.e., see “GPS” inFIG. 9). It can be appreciated that other types of location data mayalso be employed such as beacon data (e.g., see FIG. 13).

For example, in some example embodiments the monitoring operation ofmonitoring module 74 can involve estimating the distance to a particularpoint or location near the vehicle and providing a notification/alertvia the alerting module 75 in the form of an audio alert, text messageetc. ML and/or AD modules or mechanisms can be employed to detectchanges in conditions with respect to particular geographic locations.For example, the GPS data may be utilized to determine that the vehicleis rapidly approaching particular crosswalk or intersection and an alertissued to let the driver know that he or she is approaching thisparticular crosswalk or intersection, while the ML and/or AD modules ortechniques can be employed to determine if someone is in the middle ofthe crosswalk/intersection.

Possible alerts or conditions to be monitored and alerted can be, forexample, “approaching a red light,” “changing lanes,” “approaching amedian,” “15 feet to a median,” “10 feet to a median,” “at median,” etc.The camera(s) 19, 82 and so forth and the monitoring module 75 can lookfor conditions such as medians, red lights, yellow lights, etc., anddetermines how far away these things are from the vehicle.

FIG. 10 illustrates a high level flow chart of operations depictinglogical operational steps of a method 90 for alerting a vehicle driverof a change in traffic light conditions via wireless communications, inaccordance with an alternative embodiment. As indicated at block 92, theprocess can be initiated. Thereafter, as disclosed at block 94, a stepor logical operation can be implemented for detecting if the driver'svehicle/automobile is in motion. Thereafter, as shown at decision block96, a test can be performed to determine if the automobile is in motion.If so, then the monitoring process continues, as shown at block 94. Ifnot, then as indicated at block 98, a video camera (e.g., cameras 19,21, etc.) can monitor the vehicle's surroundings for traffic lightconditions. For example, a step or operation can be implemented tosearch for and identify a traffic light and its conditions (e.g., red,green, or yellow lights).

Note that a non-limiting example of a camera that can be adapted for usein accordance with the operation shown as block 98 and in someimplementations for us as the camera 19 discussed earlier herein is acolor recognition camera. A non-limiting example of a color recognitioncamera is disclosed in U.S. Pat. No. 6,803,956 entitled “ColorRecognition Camera,” which issued on Oct. 12, 2004 and is incorporatedherein by reference in its entirety. Such an example color recognitioncamera includes a red-green-blue CCD-imaging device that provides ananalog RGB-video signal. A set of three analog-to-digital convertersconverts the analog RGB-video signal into a digital RGB-video signal. Adigital comparator tests the digital RGB-video signal pixel-by-pixel fora match against a color setpoint. If a match occurs, a pixel with aparticular color represented by the color setpoint has been recognizedand a “hit” is output. A pixel address counter provides a pixel addressoutput each time a “hit” is registered. The number of hits per videoframe are accumulated, and a color-match area magnitude value is outputfor each frame. Alternatively, neural networks can be used to indicatehits when a pixel in the video image comes close enough to the colorsetpoint value. Just how close can be “learned” by the neural network.

As indicated next at block 100, a step or logical operation can beimplemented to determine if the light is red, green or yellow. If it isdetermined, as shown at block 102, that the light is red, then thetraffic light is monitored to determine if there is change from togreen. Assuming that the light changes from red to green, an alert(e.g., audio) is then issued indicating the change from red to green, asdepicted at block 104. The process can then terminate, as shown at block106.

Note that another color recognition approach that can be adapted for usein accordance with an alternative embodiment and for monitoring a changein color (e.g., traffic light change from yellow to green, red to green,etc.) is disclosed in U.S. Pat. No. 8,139,852 entitled “Colorclassification method, color recognition method, color classificationapparatus, color recognition apparatus, color recognition system,computer program, and recording medium,” which issued on Mar. 12, 2012and is incorporated herein by reference in its entirety.

Note that in some example embodiments, computer program code forcarrying out operations of the disclosed embodiments may be written inan object oriented programming language (e.g., Java, C #, C++, etc.).Such computer program code, however, for carrying out operations ofparticular embodiments can also be written in conventional proceduralprogramming languages, such as the “C” programming language or in avisually oriented programming environment, such as, for example, VisualBasic.

The program code may execute entirely on the user's computer, partly onthe user's computer, as a stand-alone software package, partly on theuser's computer and partly on a remote computer or entirely on theremote computer. In the latter scenario, the remote computer may beconnected to a user's computer through a local area network (LAN) or awide area network (WAN), wireless data network e.g., Wi-Fi, Wimax,802.xx, and cellular network or the connection may be made to anexternal computer via most third party supported networks (e.g., throughthe Internet via an Internet Service Provider).

The embodiments are described at least in part herein with reference toflowchart illustrations and/or block diagrams of methods, systems, andcomputer program products and data structures according to embodimentsof the invention. It will be understood that each block of theillustrations, and combinations of blocks, can be implemented bycomputer program instructions. These computer program instructions maybe provided to a processor of a general-purpose computer, a specialpurpose computer, or another programmable data processing apparatus toproduce a machine, such that the instructions, which execute via theprocessor of the computer or other programmable data processingapparatus, create means for implementing the functions/acts specified inthe block or blocks. In some example embodiments, a connected car or aself-driving car may themselves be considered a special purposecomputer.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meanswhich implement the function/act specified in the various block orblocks, flowcharts, and other architecture illustrated and describedherein.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe block or blocks.

FIGS. 11-12 are shown only as exemplary diagrams of data-processingenvironments in which embodiments may be implemented. It should beappreciated that FIGS. 11-12 are only exemplary and are not intended toassert or imply any limitation with regard to the environments in whichaspects or embodiments of the disclosed embodiments may be implemented.Many modifications to the depicted environments may be made withoutdeparting from the spirit and scope of the disclosed embodiments.

As illustrated in FIG. 11, some example embodiments may be implementedin the context of a data-processing system 200 that can include, forexample, one or more processors such as processor 141, a memory 142, acontroller 143, a peripheral USB (Universal Serial Bus) connection 147,a display 146, an input device (e.g., a mouse, touch screen display,etc.), a keyboard, etc. Data-processing system 200 may be, for example,a client computing device (e.g., a client PC, laptop, tablet computingdevice, smartphone, etc.) which can communicate with, for example, aserver (not shown) and/or other devices (e.g., wireless and/or wiredcommunications).

As illustrated, the various components of data-processing system 200 cancommunicate electronically through a system bus 151 or similararchitecture. The system bus 151 may be, for example, a subsystem thattransfers data between, for example, computer components withindata-processing system 200 or to and from other data-processing devices,components, computers, etc. Data-processing system 200 may beimplemented as, for example, a server in a client-server based network(e.g., the Internet) or can be implemented in the context of a clientand a server (i.e., where aspects are practiced on the client and theserver). Data-processing system 200 may also be, for example, astandalone desktop computer, a laptop computer, a Smartphone, a padcomputing device and so on. In the case of a smartphone, it can beassumed that devices such as keyboard 144, input unit 145 and so onwould implemented in the context of a touch screen display or otherappropriate mobile input interface. The data-processing system 200 canalso include or communicate with an image capturing unit 132 (e.g., avideo camera such as discussed herein, etc.).

FIG. 12 illustrates a computer software system 250 for directing theoperation of the data-processing system 200. Software application 254,stored for example in memory 202, generally includes a kernel oroperating system 251 and a shell or interface 253. One or moreapplication programs, such as software application 254, may be “loaded”(i.e., transferred from, for example, mass storage 207 or other memorylocation into the memory 201) for execution by the data-processingsystem 200. The data-processing system 200 can receive user commands anddata through the interface 253; these inputs may then be acted upon bythe data-processing system 200 in accordance with instructions fromoperating system 251 and/or software application 254. The interface 253in some example embodiments can serve to display results, whereupon auser 249 may supply additional inputs or terminate a session. Thesoftware application 254 can include one or more modules such as module252, which can, for example, implement instructions or operations suchas those described herein.

The following discussion is intended to provide a brief, generaldescription of suitable computing environments in which the system andmethod may be implemented. Although not required, the disclosedembodiments will be described in the general context ofcomputer-executable instructions, such as program modules, beingexecuted by a single computer. In most instances, a “module” constitutesa software application.

Generally, program modules include, but are not limited to, routines,subroutines, software applications, programs, objects, components, datastructures, etc., that perform particular tasks or implement particularabstract data types and instructions. Moreover, those skilled in the artwill appreciate that the disclosed method and system may be practicedwith other computer system configurations, such as, for example,hand-held devices, multi-processor systems, data networks,microprocessor-based or programmable consumer electronics, networkedPCs, minicomputers, mainframe computers, servers, and the like.

Note that the term module as utilized herein may refer to a collectionof routines and data structures that perform a particular task orimplements a particular abstract data type. Modules may be composed oftwo parts: an interface, which lists the constants, data types,variable, and routines that can be accessed by other modules orroutines; and an implementation, which is typically private (accessibleonly to that module) and which includes source code that actuallyimplements the routines in the module. The term module may also simplyrefer to an application, such as a computer program designed to assistin the performance of a specific task, such as word processing,accounting, inventory management, etc.

FIGS. 11-12 are thus intended as examples and not as architecturallimitations of disclosed embodiments. Additionally, such embodiments arenot limited to any particular application or computing or dataprocessing environment. Instead, those skilled in the art willappreciate that the disclosed approach may be advantageously applied toa variety of systems and application software. Moreover, the disclosedembodiments can be embodied on a variety of different computingplatforms, including, for example, Windows, Macintosh, UNIX, LINUX, andthe like.

FIG. 13 illustrates a schematic diagram of driver alerting system 150,in accordance with an alternative embodiment. Note that the system 150shown in FIG. 13 is similar to, for example, system 10 shown in FIG. 1.In the FIG. 13 implementation, however, a beacon 13 is shown asassociated with traffic light 22 and can be accessible by nearby mobileelectronic devices such as mobile device 21. The beacon 13 isimplemented as part of a positioning system. One example of beacon 13 isthe “iBeacon” device and associated system. The iBeacon is a trademarkof Apple Inc. for a positioning system that Apple Inc. has referred toas a new class of low-powered, low-cost transmitters that can notifynearby iOS devices of their presence. The technology enables asmartphone or other device to perform actions when in close proximity toan iBeacon or in this case beacon 13.

Thus, beacon 13 can assist the mobile computing device 21 in determiningits approximate location or context. With the assistance of beacon 13,software associated with mobile computing device 21 can approximatelyfind its relative location with respect to beacon 13 and hence withrespect to the traffic light 22 (assuming the beacon 13 is located at orproximate to the traffic light 22). The beacon 13 can communicate withdevice 21 using BLE (Bluetooth Low Energy) technology also referred toas “Bluetooth Smart”. The beacon 13 uses low energy proximity sensing totransmit a universally unique identifier picked up be a compatible “app”or operating system. The identifier can then be looked up over theInternet to determine the physical location of device 21 or trigger anaction on device 21 such as a push notification or tracking andrecording operations as discussed previously herein. One non-limitingexample of a beacon device and systems that can be adapted for use as orwith device 21 and beacon 13 and the methods/systems disclosed herein isdiscussed in U.S. Pat. No. 8,718,620 entitled “Personal Media Deviceswith Wireless Communication,” which issued on May 6, 2014 and isincorporated herein by reference.

Note that the term “driver” as utilized herein may refer to the humandriver of a vehicle or can refer an autonomous vehicle driver—meaningthe autonomous vehicle driving system itself. Thus, the various alertsdiscussed herein can be provided to the an AI (Artificial Intelligence)system that governs an autonomously driven vehicle (e.g., a self-drivingautomobile) and/or the actions of the autonomously driven vehicle. Theterm “vehicle” as utilized herein may refer to a connected vehicle(e.g., a connected car), which may be a human-driven vehicle (i.e.,driven by a human driver) or an autonomous vehicle (i.e., also known asa driverless car, a self-driving car, a robotic car, self-drivingvehicle, etc.). Such an autonomous vehicle or autonomous car is avehicle that is can sense its environment and navigate without humaninput. Thus, the term “vehicle” as utilized herein can refer to humandriven vehicles (e.g., vehicles driven by a human driver) or anautonomous vehicle. In the case of an autonomous car, a “driver” canrefer to a non-human driver such as an AI-enabled autonomous driver(i.e., the AI system that governs or operates the self-driving vehicle).For example, the data-processing system 200 can in some exampleembodiments be implemented as an AI data-processing system that governsan autonomous vehicle. In other example embodiments, the data-processingsystem may be the computer system for a connected vehicle (e.g., aconnected car), which may or may not be a human-driven vehicle driven bya human driver rather than an AI driver. In some example embodiments,the vehicle may be a combination of a human driven vehicle and an AIdriven vehicle. That is, some vehicles may include both a “human drivermode” and an “AI driver mode”.

Based on the foregoing, it can be appreciated that a number of exampleembodiments, preferred and alternative, are disclosed herein. Forexample, in one embodiment, a method for alerting a vehicle driver viawireless communications can be implemented. Such a method can includethe steps, instructions or logical operations of, for example:monitoring one or more conditions with respect to a vehicle; detecting achange in the condition (or conditions); transmitting a signalwirelessly to a computing device, the signal indicative of the change inthe condition(s); and alerting the driver of the change in thecondition(s) in response to transmitting the signal to the computingdevice. In some example embodiments, the computing device may be, forexample, a wireless hand held electronic device such as a smartphone ortablet computing device (e.g., iPad, Android tablet, etc.). In otherembodiments, the table computing device may actually be integrated withthe vehicle.

In some example embodiments, the step or logical operation of alertingthe driver of the change in the condition(s) further comprises providingan audible alert via a speaker associated with the computing device, theaudible alert indicative of the change in condition(s). In anotherembodiment, the step or logical operation of alerting the driver of thechange in the condition(s) can further include steps or logicaloperations for establishing a wireless connection between the computingdevice and a radio system of the vehicle; providing an audible alertfrom the computing device indicative of the change in the condition(s)via the radio system.

In yet another example embodiment, the step or logical operation ofalerting the driver of the change in the condition(s) can furtherinclude the step or logical operation of alerting the driver of thechange in the condition by a text message displayable through thecomputing device. In still another embodiment, monitoring thecondition(s) with respect to a vehicle can further involve monitoringsuch condition(s) with a camera. In some example embodiments, such acamera may be, for example, an HD video camera, a 360 degree videocamera, etc.

In other example embodiments, the step or logical operation ofmonitoring the condition(s) with respect to the vehicle can furtherinclude a step or logical operation of monitoring the condition(s) withone or more sensors (e.g., temperature sensor, tire pressure sensor,etc.). In yet other embodiments, the step or logical operation ofmonitoring the condition(s) can further involve a step or logicaloperation of analyzing video data from the 360 degree video camerautilizing anomaly detection. In still other example embodiments, thestep or logical operation of monitoring the condition(s) can furtherinvolve the step or logical operation of analyzing video data from the360 degree video camera utilizing machine learning. In yet anotherembodiment the step or logical operation of monitoring the condition(s)can further include a step or logical operation of monitoring thecondition(s) by analyzing video data from the 360 degree video camerautilizing location data (e.g., GPS data, beacon data, etc.) from alocation module (e.g., GPS module, iBeacon, etc.) associated with, forexample, the computing device or the vehicle itself (e.g., an in-vehiclemounted GPS unit).

In another example embodiment, a method for alerting a vehicle drivervia wireless communications, can be implemented. Such a method caninclude the steps or logical operations of monitoring one or moreconditions external to a vehicle while the vehicle is in operation and adriver of the vehicle is located in a driver seat of the vehicle;detecting a change in the condition(s); transmitting a signal wirelesslyto a computing device, the signal indicative of the change in thecondition(s); and alerting the driver of the change in the condition(s)after transmission of the signal to the computing device.

In some example embodiments, the step or logical operation of alertingthe driver of the change in the condition(s) after transmission of thesignal to the computing device, can further include a step or logicaloperation of providing an audible alert via a speaker associated withthe computing device, the audible alert indicative of the change in theat least one condition. In still another embodiment, the step or logicaloperation of alerting the driver of the change in the condition(s) aftertransmission of the signal to the computing device, can further includethe steps or logical operation of establishing a wireless connectionbetween the computing device and a radio system of the vehicle; andproviding an audible alert from the computing device indicative of thechange in the condition(s) via the radio system. In some exampleembodiments, the “vehicle in operation” can include at least one of: thevehicle in motion, or the vehicle temporarily stopped (i.e., yet stillin operation, such as the vehicle temporarily stopped at anintersection).

In another example embodiment, the step or logical operation of alertingthe driver of the change in the at least one condition aftertransmission of the signal to the computing device, can further includethe step or logical operation of providing an audible alert via aspeaker associated with the computing device, the audible alertindicative of the change in the at least one condition. In anotherexample embodiment, the step of logical operation of alerting the driverof the change in the at least one condition after transmission of thesignal to the computing device, can further include the steps or logicaloperations of establishing a wireless connection between the computingdevice and a radio system of the vehicle; and providing an audible alertfrom the computing device indicative of the change in the at least onecondition via the radio system.

In still another example embodiment, the step or logical operation ofmonitoring a condition external to a vehicle while the vehicle is inoperation and a driver of the vehicle is located in a driver seat of thevehicle, can further include the step or logical operation of monitoringthe at least one condition with a camera that communicates with thecomputing device. In some example embodiments, the aforementioned cameramay be integrated with the computing device or can be a standalonecamera positioned within the vehicle to monitor the at least onecondition and wherein the standalone camera communicates via a wirelessconnection with the computing device. In some cases more than one cameramay be employed (e.g., both the standalone camera and the cameraintegrated with the computing device).

In other example embodiment, steps or logical operations can be providedfor tracking and recording in a memory of a computing system dataindicative of a number of times the driver is alerted to the change inthe at least one condition. Additionally, steps or logical operationsmay be provided for periodically retrieving the data from the memory;and transmitting the data wirelessly from the computing system to acentral repository for further storage and analysis.

In some example embodiments, the at least one condition external to thevehicle may be, for example, a stop light condition and the change inthe at least one condition comprises a change from one stop light colorto another stop light color.

In another example embodiment the step or logical operation oftransmitting the signal wirelessly to the computing device, the signalindicative of the change in the at least one condition, can furtherinclude or involve a step or logical operation of transmitting thesignal wirelessly through a PAN (Personal Area Network). In some exampleembodiments, such a PAN can be a network enabled for example, for:Bluetooth wireless communications, induction wireless communications,infrared wireless communications, ultra-wideband wireless communicationsand ZigBee wireless communications. In some example embodiments, thewireless connection between the computing device and the radio systemcan be established via Secure Simple Pairing (SSP).

In other embodiments, the step or logical operation of detecting thechange in the at least one condition can further involve a step orlogical operation for utilizing an anomaly detection mechanism to detectthe change in the at least one condition.

In another example embodiment, steps or logical operations can beprovided for determining if the vehicle is no longer in operation;monitoring at least one condition within the vehicle, in response todetermining that the vehicle is no longer in operation; determining ifthe at least one condition within the vehicle comprises an anomalouscondition; and wirelessly transmitting an alert to a computing deviceassociated with the user, the alert indicative of the anomalouscondition, if is determined that the at least one condition comprisesthe anomalous condition. In yet another example embodiment the alert canbe wirelessly transmitted as a text message to the computing device viaa wireless network.

In another example embodiment, a system for alerting a vehicle drivervia wireless communications, can be implemented. Such a system caninclude, for example, a video camera (one or more video cameras), atleast one processor that communicates with and processes video datacaptured by the video camera; and a computer-usable medium embodyingcomputer program code, the computer-usable medium capable ofcommunicating with the at least one processor. The computer program codecan include instructions executable by the at least one processor andconfigured for example, for: monitoring at least one condition withrespect to a vehicle with the video camera; detecting a change in the atleast one condition monitored with the video camera; transmitting asignal wirelessly to a computing device, the signal indicative of thechange in the at least one condition; and alerting the driver of thechange in the at least one condition in response to transmitting thesignal to the computing device. As indicated previously, the computingdevice may be, for example, a smartphone, a tablet computing device oran-vehicle computing system (or a combination of both).

In some example embodiments, the aforementioned instructions foralerting the driver of the change in the at least one condition can befurther configured for providing an audible alert via a speakerassociated with the computing device, the audible alert indicative ofthe change in the at least one condition. In some situations, the speakmay be, for example, a speaker integrated with a smartphone, tabletcomputing device, etc. The speaker may also be an audio speakerassociated with an in-vehicle system such as discussed herein.

In other embodiments, the aforementioned instructions for alerting thedriver of the change in the at least one condition can be furtherconfigured for establishing a wireless connection between the computingdevice and a radio system of the vehicle; and providing an audible alertfrom the computing device indicative of the change in the at least onecondition via the radio system.

In yet another example embodiment, the instructions for alerting thedriver of the change in the at least one condition can further includeinstructions configured for alerting the driver of the change in thecondition by a text message displayable through the computing device.

In some example embodiments, such a camera may be a 360 degree videocamera. In other embodiments, one or more sensors can also be employedfor use in monitoring the condition(s). In another example embodiment,the instructions for monitoring the at least one condition can includeinstructions for analyzing the video data captured from the 360 degreevideo camera utilizing anomaly detection. In yet another exampleembodiment, the instructions for monitoring the at least one conditioncan further include instructions for analyzing the video data capturedfrom the 360 degree video camera utilizing machine learning. In stillanother example embodiment, the instructions for monitoring the at leastone condition can further involve or include instructions for analyzingthe video data captured from the 360 degree video camera utilizinglocation data from a location (e.g., GPS module, beacon, etc.)associated with the computing device.

In yet another example embodiment, a method can be implemented foralerting a vehicle via wireless communications. Such an example methodcan includes steps or operations such as, for example, monitoring atleast one condition external to a vehicle while the vehicle is inoperation and a passenger in the vehicle is located in a passenger seatof the vehicle and the vehicle is stopped; detecting a change in the atleast one condition external to the vehicle during the monitoring of theat least one condition while the vehicle is stopped (e.g., temporarilystopped or idling at a traffic intersection, stuck in traffic, pulledover along the highway, etc.); transmitting a signal wirelessly to acomputing device, the signal is indicative of the change in the at leastone condition external to the vehicle; and alerting the passenger of thechange in the at least one condition external to the vehicle aftertransmission of the signal to the computing device.

In another example embodiment, the step or operation of alerting thepassenger about the change in the at least one condition external to thevehicle after transmission of the signal to the computing device, canfurther involve or include a step or operation of providing an audiblealert via a speaker associated with the computing device (e.g., anintegrated in-vehicle computing system, a smartphone, a smartwatch orother wearable computing device, a laptop computer, a tablet computingdevice, and so on), the audible alert indicative of the change in the atleast one condition external to the vehicle.

In still another example embodiment, the step or operation of alertingthe passenger of the change in the at least one condition external tothe vehicle after transmission of the signal to the computing device,can further includes steps or operations for establishing a wirelessconnection between the computing device and a radio system of thevehicle; and providing an audible alert from the computing deviceindicative of the change in the at least one condition external to thevehicle, wherein the audible alert is broadcast via the radio system,after the establishing the wireless connection between the computingdevice and the radio system of the vehicle.

In yet another example embodiment, the at least one condition can be,for example, at least one condition of a traffic light (e.g., the statusof a traffic light, is it red, yellow or green, or is the light changingcolor?) In other example embodiment, the change in the at least onecondition external to the vehicle can be a change in the movement of apedestrian external to the vehicle (e.g., pedestrian walking near thevehicle, in a crosswalk, etc.). In other words, this feature relates topedestrian detection. In another example embodiment, the at least onecondition external to the vehicle can be a stop light condition and thechange in the at least one condition comprises a change from one stoplight color to another stop light color.

In another example embodiment, the step or operation of alerting thepassenger of the change in the at least one condition after transmissionof the signal to the computing device, can further include steps oroperations for establishing a wireless connection between the computingdevice and a radio system of the vehicle; and providing an audible alertfrom the computing device indicative of the change in the at least onecondition via the radio system.

In yet another example embodiment, the step or operation of monitoring acondition external to a vehicle while the vehicle is in operation and apassenger of the vehicle is located in a passenger seat of the vehicle,can further include a step or operation of monitoring the at least onecondition with a camera that communicates with the computing device.

In still another example embodiment, a telematics step or operation canbe implemented for tracking and recording in a memory of a computingsystem data indicative of a number of times the passenger is alerted tothe change in the at least one condition external to the vehicle whilethe vehicle is stopped.

In still another example embodiment, steps or operations can be providedfor periodically retrieving the data from the memory; and transmittingthe data wirelessly from the computing system to a central repositoryfor further storage and analysis.

In another example embodiment, an autonomous vehicle provides alerts toa passenger of the vehicle via wireless communications. Such anautonomous vehicle includes a passenger compartment with a passengerseat; at least one processor; and a non-transitory computer-usablemedium embodying computer program code. The computer-usable medium iscapable of communicating with the at least one processor, and thecomputer program code can include instructions executable by the atleast one processor and configured for example, for: monitoring at leastone condition external to the vehicle while the vehicle is in operationand a passenger in the vehicle is located in the passenger seat of thevehicle and the vehicle is temporarily stopped; detecting a change inthe at least one condition external to the vehicle during the monitoringof the at least one condition while the vehicle is stopped; transmittinga signal wirelessly to a computing device, wherein the signal isindicative of the change in the at least one condition external to thevehicle; and alerting the passenger (through, for example, thepassenger's own computing device such as a smartphone or tabletcomputing device or an integrated in-car computing system) of the changein the at least one condition external to the vehicle after transmissionof the signal to the computing device.

In some example embodiments, the aforementioned instructions foralerting the passenger of the change in the at least one conditionexternal to the vehicle after transmission of the signal to thecomputing device, can be further configured for providing an audiblealert via a speaker associated with the computing device, the audiblealert indicative of the change in the at least one condition external tothe vehicle.

In another example embodiment, the aforementioned instructions foralerting the passenger of the change in the at least one conditionexternal to the vehicle after transmission of the signal to thecomputing device, can be further configured for: establishing a wirelessconnection between the computing device and a radio system of thevehicle; and providing an audible alert from the computing deviceindicative of the change in the at least one condition external to thevehicle, wherein the audible alert is broadcast via the radio system,after the establishing the wireless connection between the computingdevice and the radio system of the vehicle.

In another example embodiment, a system for alerting a passenger of avehicle via wireless communications, can be implemented. Such a systemcan include, for example, at least one processor; and a non-transitorycomputer-usable medium embodying computer program code. Thecomputer-usable medium is capable of communicating with the at least oneprocessor. The program code can include instructions executable by theat least one processor and configured for: monitoring at least onecondition external to the vehicle while the vehicle is in operation anda passenger in the vehicle is located in the passenger seat of thevehicle and the vehicle is temporarily stopped; detecting a change inthe at least one condition external to the vehicle during the monitoringof the at least one condition while the vehicle is temporarily stopped;transmitting a signal wirelessly to a computing device, the signal isindicative of the change in the at least one condition external to thevehicle; and alerting the passenger of the change in the at least onecondition external to the vehicle after transmission of the signal tothe computing device.

The flowcharts and block diagrams in the different depicted embodimentsillustrate the architecture, functionality, and operation of somepossible implementations of apparatus, methods and computer programproducts. In this regard, each block in the flowchart or block diagramsmay represent a module, segment, or portion of code, which comprises oneor more executable instructions for implementing the specified functionor functions. In some alternative implementations, the function orfunctions noted in the block may occur out of the order noted in thefigures. For example, in some cases, two blocks shown in succession maybe executed substantially concurrently, or the blocks may sometimes beexecuted in the reverse order, depending upon the functionalityinvolved.

The embodiments can take the form of an entire hardware embodiment, anentire software embodiment, or an embodiment containing both hardwareand software elements. In a preferred embodiment, the invention isimplemented in software, which includes but is not limited to firmware,resident software, microcode, etc.

Furthermore, the invention can take the form of a computer programproduct accessible from a computer-usable or computer-readable mediumproviding program code for use by or in connection with a computer orany instruction execution system. For the purposes of this description,a computer-usable or computer readable medium can be any tangibleapparatus that can contain, store, communicate, propagate, or transportthe program for use by or in connection with the instruction executionsystem, apparatus, or device.

The medium can be an electronic, magnetic, optical, electromagnetic,infrared, or semiconductor system (or apparatus or device). Examples ofa computer-readable medium include a semiconductor or solid statememory, magnetic tape, a removable computer diskette, a random accessmemory (RAM), a read-only memory (ROM), a rigid magnetic disk, a Flashdrive, an optical disk, etc. Examples of optical disks include compactdisk-read only memory (CD-ROM), compact disk-read/write (CD-R/W), andDVD.

Some example embodiments may be implemented in the context of aso-called “app” or software application. An “app” is a self-containedprogram or piece of software designed to fulfill a particular purpose;an application, especially as downloaded by a user to a mobile device(e.g., smartphone, tablet computing device, etc.).

It will be appreciated that variations of the above-disclosed and otherfeatures and functions, or alternatives thereof, may be desirablycombined into many other different systems or applications. Also, thatvarious presently unforeseen or unanticipated alternatives,modifications, variations or improvements therein may be subsequentlymade by those skilled in the art which are also intended to beencompassed by the following claims.

What is claimed is:
 1. A monitoring system for a vehicle, comprising:one or more sensors; one or more processors; and a memory storinginstructions that, when executed by the one or more processors, causethe monitoring system to: establish a wireless connection to a computingdevice of a driver of the vehicle; using the one or more sensors,monitor at least one condition external to the vehicle while the driveris operating the vehicle and the vehicle is temporarily stopped; detecta change in the at least one condition external to the vehicle; and inresponse to detecting the change, transmit a signal wirelessly to thecomputing device of the driver, the signal causing the computing deviceto output an alert indicating the change in the at least one conditionexternal to the vehicle.
 2. The monitoring system of claim 1, whereinthe signal causes the computing device of the driver to output anaudible alert.
 3. The monitoring system of claim 1, wherein the signalcauses the computing device of the driver to output a visual alert. 4.The monitoring system of claim 1, wherein the at least one conditioncomprises at least one condition of a traffic light, and wherein thechange in the at least one condition external to the vehicle comprises achange in the at least one condition of the traffic light.
 5. Themonitoring system of claim 4, wherein the change in the at least onecondition of the traffic light comprises a change from one traffic lightcolor to another traffic light color.
 6. The monitoring system of claim1, wherein the at least one condition comprises a movement of apedestrian external to the vehicle.
 7. The monitoring system of claim 1,wherein the computing device comprises a smartphone or a tabletcomputing device.
 8. The monitoring system of claim 1, wherein the oneor more sensors comprise a camera, and wherein the executed instructionscause the monitoring system to monitor the at least one conditionexternal to the vehicle by monitoring image data generated by thecamera.
 9. The monitoring system of claim 1, wherein the executedinstructions further cause the monitoring system to: track and record,in the memory, data indicating a number of times the driver is alertedto the change in the at least one condition external to the vehicle. 10.The system of claim 9, wherein the executed instructions further causethe system to: periodically retrieve the data from the memory; andtransmit the data wirelessly to a central repository for storage andanalysis.
 11. A non-transitory computer readable medium storinginstructions that, when executed by one or more processors, cause theone or more processors to: establish a wireless connection to acomputing device of a driver of the vehicle; using one or more sensors,monitor at least one condition external to a vehicle while the driver isoperating the vehicle and the vehicle is temporarily stopped; detect achange in the at least one condition external to the vehicle; and inresponse to detecting the change, transmit a signal wirelessly to thecomputing device of the driver, the signal causing the computing deviceto output an alert indicating the change in the at least one conditionexternal to the vehicle.
 12. The non-transitory computer readable mediumof claim 11, wherein the signal causes the computing device of thedriver to output an audible alert.
 13. The non-transitory computerreadable medium of claim 11, wherein the signal causes the computingdevice of the driver to output a visual alert.
 14. The non-transitorycomputer readable medium of claim 11, wherein the at least one conditioncomprises at least one condition of a traffic light, and wherein thechange in the at least one condition external to the vehicle comprises achange in the at least one condition of the traffic light.
 15. Thenon-transitory computer readable medium of claim 14, wherein the changein the at least one condition of the traffic light comprises a changefrom one traffic light color to another traffic light color.
 16. Thenon-transitory computer readable medium of claim 11, wherein the atleast one condition comprises a movement of a pedestrian external to thevehicle.
 17. The non-transitory computer readable medium of claim 11,wherein the computing device comprises a smartphone or a tabletcomputing device.
 18. The non-transitory computer readable medium ofclaim 11, wherein the one or more sensors comprise a camera, and whereinthe executed instructions cause the monitoring system to monitor the atleast one condition external to the vehicle by monitoring image datagenerated by the camera.
 19. The non-transitory computer readable mediumof claim 11, wherein the executed instructions further cause themonitoring system to: track and record, in the memory, data indicating anumber of times the driver is alerted to the change in the at least onecondition external to the vehicle.
 20. A computer-implemented method ofmonitoring a vehicle, the method being performed by one or moreprocessors and comprising: establish a wireless connection to acomputing device of a driver of the vehicle; using one or more sensors,monitoring at least one condition external to a vehicle while the driveris operating the vehicle and the vehicle is temporarily stopped;detecting a change in the at least one condition external to thevehicle; and in response to detecting the change, transmitting a signalwirelessly to the computing device of the driver, the signal causing thecomputing device to output an alert indicating the change in the atleast one condition external to the vehicle.